专利摘要:
To provide an apparatus for embedding watermark data according to the frequency-domain method efficiently into video data, a video-data encoder of the invention for performing encoding of an original video data into a compressed data stream having a multi-layer structure comprises; means (101) for transforming the original video data into a sequence of processing units of frequency domain data; means (103) for embedding predetermined watermark data into at least one unit of the sequence of processing units; and means (104 and 105) for generating the compressed data stream by processing the sequence of processing units. Therefore, the data transformation of the original video data into the frequency domain data for embedding the watermark data can be performed efficiently without any additional process, by exploiting the data transformation for encoding the original video data into the compressed data stream.
公开号:US20010001613A1
申请号:US09/028,066
申请日:1998-02-23
公开日:2001-05-24
发明作者:Masahiro Hashimoto
申请人:NEC Corp;
IPC主号:G06T1-0035
专利说明:
[0001] The present invention relates to modification of video data, and particularly to that for synthesizing identification data thereto for identifying the video data. [0001]
[0002] Illegal reproduction of digital video data is an actual problem. For preventing the illegal reproduction, there is proposed a playback system wherein digital video data are encoded into cipher data which can be played back only by video players equipped with a proper decipher key. However, even the ciphered video data, the illegal reproduction cannot be prevented once they are deciphered. [0002]
[0003] Hence, embedding special information into the digital video data themselves is attempted for preventing the illegal usage and reproduction for preventing the illegal usage and reproduction. In the following paragraphs, data representing this special information will be called the electronic watermark data. [0003]
[0004] The electronic watermark data can be classified into two kinds, that is, visible electronic watermark data and invisible electronic watermark data. [0004]
[0005] An example of the visible electronic watermark data is disclosed in a Japanese patent application laid open as a Provisional Publication No. 241403/'96. In the example, for synthesizing the electronic watermark data into original picture data, brightness values of original pixel data corresponding to opaque pixel of the electronic watermark are modified leaving color differential components thereof unchanged. When modifying the brightness values, scaling factor to be applied for the modification may be determined according to color component, random number, pixel value of the electronic water mark, or others. [0005]
[0006] Thus, the visible electronic watermark modifies a picture so that the modification may be sensed visually by comparing, or even without comparing, to its original, by synthesizing special characters or marks into the picture. Hence, the visible electronic watermark is effective to appeal the prevention of illegal use to the observer. However, degradation of picture quality is, more or less, unavoidable. [0006]
[0007] On the other hand, the invisible electronic watermark is the watermark unable to be sensed visually, being embedded within image data not to degrade the picture quality. [0007]
[0008] By embedding, into a video program, special information for identifying its licensee, for example, as the invisible electronic watermark, identification of the licensee becomes possible by extracting the watermark data from illegal copies of the video program. It becomes also possible, by embedding reproduction-prohibitive information in the program, to alarm or restrict a user to make duplication by a VTR (Video Tape Recorder), by functioning a copy prevention mechanism therein, for example, when the reproduction-prohibitive information is detected by the VTR. [0008]
[0009] The invisible electronic watermark data may be embedded into a part of image data which gives little affect to the picture quality, such as into LSB (Least Significant Bit) of each pixel value. [0009]
[0010] However, when the watermark is embedded into the LSB, it can be easily eliminated by way of a low-pass filter. Further, the image data compression generally stands on reducing data amount by omitting data parts giving little affect to the picture quality. That means the watermark embedded there is also eliminated by the image data compression. [0010]
[0011] As above described, there has been a tradeoff between the picture quality and the traceability of the watermark in the invisible electronic watermark. [0011]
[0012] For evading this tradeoff, a method of embedding the watermark data into frequency spectrum data of an image is proposed (in p. 13 of the [0012] NIKKEI ELECTRONICS, no. 660, Apr. 22, 1996). In this method, which will be called the frequency-domain method in the following paragraphs, being embedded into frequency components, the watermark data have sufficient durability to the image data processing such as data compression or filtering, and further, interference between different watermark data is also prevented, making difficult to break the watermark data without giving serious affects throughout the picture.
[0013] In the frequency-domain method, the electronic watermark is embedded as follows, for example. [0013]
[0014] Original image data are transferred into frequency components by way of the DCT (Discrete Cosine Transform). Selecting n components f(1), f(2), . . . , f(n) each having higher n values among the frequency components thus obtained, an electronic watermark data set w(1), w(2), . . . , w(n) is prepared so as to accord to a normal distribution having a mean value 0 and a variance 1. Then, F(i)=f(i)+α|f(i)|×w(i) is calculated for each i (i=1, 2, . . . , n), α being a scale factor. From the frequency components wherein each f(i) is replaced with F(i), the image data including the electronic watermark are obtained. [0014]
[0015] For detecting the electronic watermark, following processes are performed, for example, on condition that the original image data and the probable watermark data set w(i) (i=1, 2, . . . , n) are known. [0015]
[0016] First, frequency components F(1) to F(n) corresponding to those f(1) to f(n) of the original image as above defined are extracted from image data wherein the electronic watermark is considered to be embedded. Then, each i-th component W(i) of a probable data set vector W=(W(1), W(2), . . . , W(n)) is calculated as W(i)=(F(i)−f(i))/f(i). When a static resemblance C of the probable data set vector W to the watermark data set vector w=(w(1), w(2), . . . , w(n)) obtained from their normalized inner product represented by C= W·w/(|W|·|w|) is larger than a certain value, the concerning electronic watermark is determined to be embedded in the object image data. [0016]
[0017] Thus, the author of the original image can effectively verify illegal copies by detecting the electronic watermark embedded by the frequency-domain method in the digital image data according to each licensee. [0017]
[0018] FIG. 6 is a block diagram illustrating a data modifier to be applied to the prior art for embedding the electronic watermark data by way of the frequency-domain method. Original image data [0018] 601 are converted into frequency components by a DCT processor 602, which are modified by a watermark embedder 603 according to a watermark data set 604 and converted by an inverse DCT processor 605 into time-domain data to be output as the watermarked image data 606.
[0019] Suppose here to apply the above frequency-domain method to MPEG (Moving Picture Expert Group) video data. FIG. 7 is a block diagram illustrating basic configuration of a video-data encoder [0019] 700 for generating the MPEG video data, wherein are comprised a DCT processor 101 for converting an original video data stream 110 into frequency-domain data, a quantizer 104 for thinning out negligible data therefrom and a variable-length coder 105 for encoding the quantized data into the MPEG data stream 120. As can be seen from FIGS. 6 and 7, two times of DCT should be performed when the data modifier of FIG. 6 is directly applied in the video-data encoder 700 of FIG. 7. The encoding procedure of the video data into compressed data charges a heavy load to the encoder needing a large amount of operation. Therefore, operational load for embedding the electronic watermark is expected, without saying, to be as small as possible. SUMMARY OF THE INVENTION
[0020] Therefore, a primary object of the present invention is to provide a method of and and apparatus for embedding watermark data according to the frequency-domain method efficiently into video data. [0020]
[0021] In order to achieve the object, a video-data encoder of the invention for performing encoding of an original video data into a compressed data stream having a multi-layer structure comprises; [0021]
[0022] means for transforming the original video data into a sequence of processing units of frequency domain data, said processing units being components of a predetermined layer of the multi-layer structure; [0022]
[0023] means for embedding predetermined watermark data into at least one unit of the sequence of processing units; and [0023]
[0024] means for generating the compressed data stream by processing the sequence of processing units. [0024]
[0025] Therefore, the data transformation of the original video data into the frequency domain data for embedding the watermark data according to the frequency-domain method can be performed efficiently without any additional process, by exploiting the data transformation for encoding the original video data into the compressed data stream. [0025]
[0026] Further, in an embodiment of the invention, where the encoding is performed according to the MPEG standard, the watermark data are embedded into one or some of macro-blocks determined referring to a criterion defined in connection with anyone of a slice, a picture, a field, a frame, or a GOP. [0026]
[0027] Therefore, additional load of the video-data encoder for embedding the watermark data can be still suppressed. [0027] BRIEF DESCRIPTION OF THE DRAWINGS
[0028] The foregoing, further objects, features, and advantages of this invention will become apparent from a consideration of the following description, the appended claims, and the accompanying drawings wherein the same numerals indicate the same or the corresponding parts. [0028]
[0029] In the drawings: [0029]
[0030] FIG. 1 is a block diagram illustrating a first embodiment of the invention; [0030]
[0031] FIG. 2 is a flowchart illustrating operational flow of the video-data encoder [0031] 100 of FIG. 1;
[0032] FIG. 3 shows a part of layer structure of the MPEG data; [0032]
[0033] FIG. 4 is a block diagram illustrating configuration of a video-data encoder [0033] 400 according to a second embodiment of the invention;
[0034] FIG. 5 is a flowchart illustrating operational flow of the video-data encoder [0034] 400;
[0035] FIG. 6 is a block diagram illustrating a data modifier to be applied to a prior art for embedding the electronic watermark by way of the frequency-domain method; and [0035]
[0036] FIG. 7 is a block diagram illustrating basic configuration of a video-data encoder [0036] 700 for generating the MPEG data. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0037] Now, embodiments of the present invention will be described in connection with the drawings. [0037]
[0038] FIG. 1 is a block diagram illustrating a first embodiment of the invention, wherein a video-data encoder [0038] 100 according to the embodiment comprises;
[0039] a DCT processor [0039] 101 for performing Discrete Cosine Transform of an original image data stream 110 wherein electronic watermark data 102 are to be embedded,
[0040] a watermark embedder [0040] 103 for modifying output of the DCT processor 101 according to the electronic watermark data 102,
[0041] a quantizer [0041] 104 for thinning out negligible data from output of the watermark embedder 103, and
[0042] a variable-length coder [0042] 105 for generating variable-length code data from output of the quantizer 104 to be output as an MPEG data stream 120.
[0043] FIG. 2 is a flowchart illustrating operational flow of the video-data encoder [0043] 100.
[0044] Data of the original image data stream [0044] 110 are read out (at step S1) block by block (each having 8×8 pixels) and transformed into frequency-domain data by the DCT processor 101 (at step S2). Each time when data corresponding to a macro-block (having 16×16 pixels) are transformed, the electronic watermark data 102 are embedded into the macro-block (at step S3) by the watermark embedder 103 as described previously concerning the frequency-domain method. The macro-block modified with the electronic watermark data 102 is quantized by the quantizer 104 (at step S4), and coded into variable-length codes (at step S5) by the variable-length coder 105 to be output (at step S6) as the MPEG data stream 120.
[0045] Thus, the electronic watermark data [0045] 102 can be embedded into a video data without needing any additional DCT processing in the embodiment, exploiting the DCT process performed along with the MPEG encoding of the video data. Here, each of n components of data set w representing the electronic watermark data 102 is embedded into each of n largest frequency components of the frequency-domain data. Therefore, the electronic watermark data 102 are least affected by the quantization performed by the quantizer 104.
[0046] In the following paragraphs, a second embodiment of the invention will be described referring to FIGS. [0046] 3 to 5.
[0047] FIG. 3 shows a part of layer structure of the MPEG data. A GOP (Group Of Pictures) layer [0047] 303 comprises picture layers I (Intra-picture), P (Predictive-picture) and B (Bidirectionally Predictive-picture). Each (302) of the picture layers comprises slice layers, each (301) consisting of the macro-blocks denoted by M. As for the pictures, fields or frames may be assigned.
[0048] In the first embodiment, the electronic watermark data [0048] 102 are embedded for every macro-block along with the MPEG encoding procedure. However, total operational load still amounts considerably high since the MPEG encoding itself needs a large amount of operation. Therefore, the electronic watermark data 102 are embedded into one or some of macro-blocks of every slice layer in the second embodiment, for lightening the operational load of the MPEG encoding procedure including embedding the electronic watermark data 102.
[0049] FIG. 4 is a block diagram illustrating configuration of a video-data encoder [0049] 400 according to the second embodiment, wherein a macro-block selector 401 is further comprised in addition to the video-data encoder 100 of FIG. 1. Operation of the video-encoder 400 is illustrated by a flowchart of FIG. 5.
[0050] At steps S[0050] 1 and S2, the original image data stream 110 is transformed block by block into frequency-domain data, in the same way in the first embodiment. When the watermark embedder 103 receives a macro-block, the macro-block selector 401 indicates whether the watermark embedder 103 should or not embed the electronic watermark data 102 into concerning macro-block (at step T1), referring to a criterion predetermined for a slice layer, in the second embodiment. Into the macro-blocks indicated to embed the electronic watermark data 102, the electronic watermark data 102 are embedded (at step S3) by the watermark embedder 103, other macro-blocks being output as they are. The output of the watermark embedder 103 is quantized (at step S4) by the quantizer 104, and coded into variable-length codes (at step S5) by the variable-length coder 105 in the same way with the first embodiment for generating the MPEG data stream 120 (at step S6).
[0051] Thus, the operational load of the MPEG encoding procedure including embedding the electronic watermark data [0051] 102 can be lightened still more than the first embodiment by limiting member of macroblocks in a slice layer wherein the electronic watermark data 102 are embedded, in the second embodiment.
[0052] Heretofore, the present invention is described in connection with the above two embodiment. However, it can be easily understood that various applications can be considered in the scope of the present invention. For example, the criterion for selecting the macro-block to embed the electronic watermark data [0052] 102 is described to be determined for a slice layer. However the criterion may be defined in connection with a picture, a field, a frame, or a GOP, in the scope of the invention.
[0053] Furthermore, it can be also understood that the embodiments of the invention can be easily implemented by way of a computer with a program prepared in data-recording media. [0053]
权利要求:
Claims (8)
[1" id="US-20010001613-A1-CLM-00001] 1. Data-recording media wherein a program for implementing encoding of an original video data by way of a computer into a compressed data stream having a multi-layer structure; said encoding comprising steps of:
storing a predetermined electronic watermark data in a main memory of the computer;
transforming the original video data into a sequence of processing units of frequency domain data, said processing units being components of a predetermined layer of the multi-layer structure;
embedding the predetermined watermark data into at least one unit of the sequence of processing units; and
generating the compressed data stream by processing the sequence of processing units.
[2" id="US-20010001613-A1-CLM-00002] 2. The data-recording media recited in
claim 1 ; said encoding further comprising a step of determining said at least one unit referring to a predetermined criterion.
[3" id="US-20010001613-A1-CLM-00003] 3. The data-recording media recited in
claim 1 ; wherein:
said encoding is performed according to an MPEG (Moving Picture Expart Group) standard; and
said sequence of processing units is a sequence of macro-blocks defined in the MPEG standard.
[4" id="US-20010001613-A1-CLM-00004] 4. The data-recording media recited in
claim 2 ; wherein:
said encoding is performed according to an MPEG standard;
said sequence of processing units is a sequence of macro-blocks defined in the MPEG standard; and
said predetermined criterion is defined in connection with anyone of a slice, a picture, a field, a frame, and a GOP (Group Of Picture) of the multi-layer structure.
[5" id="US-20010001613-A1-CLM-00005] 5. A video-data encoder for performing encoding of an original video data into a compressed data stream having a multi-layer structure; said video-data encoder comprising:
means for transforming the original video data into a sequence of processing units of frequency domain data, said processing units being components of a predetermined layer of the multi-layer structure;
means for embedding predetermined watermark data into at least one unit of the sequence of processing units; and
means for generating the compressed data stream by processing the sequence of processing units.
[6" id="US-20010001613-A1-CLM-00006] 6. The video-data encoder recited in
claim 5 ; further comprising means for determining said at least one unit referring to a predetermined criterion.
[7" id="US-20010001613-A1-CLM-00007] 7. The video-data encoder recited in
claim 5 ; wherein:
said encoding is performed according to an MPEG standard; and
said sequence of processing units is a sequence of macro-blocks defined in the MPEG standard.
[8" id="US-20010001613-A1-CLM-00008] 8. The video-data encoder recited in
claim 6 ; wherein:
said encoding is performed according to an MPEG standard;
said sequence of processing units is a sequence of macro-blocks defined in the MPEG standard; and
said predetermined criterion is defined in connection with anyone of a slice, a picture, a field, a frame, and a GOP of the multi-layer structure.
类似技术:
公开号 | 公开日 | 专利标题
US6553070B2|2003-04-22|Video-data encoder and recording media wherein a video-data encode program is recorded
US7159117B2|2007-01-02|Electronic watermark data insertion apparatus and electronic watermark data detection apparatus
JP3349910B2|2002-11-25|Image data encoding system
CA2225867C|2001-09-11|Identification data insertion and detection system for digital data
US6668068B2|2003-12-23|Image attribute altering device and electronic watermark embedding device
CA2260094C|2002-10-01|A method for inserting and detecting electronic watermark data into a digital image and a device for the same
US6341350B1|2002-01-22|Device and method for processing image data, transmitting medium, and recording medium
US7197164B2|2007-03-27|Time-varying video watermark
US7502488B2|2009-03-10|Image processing apparatus, program, and storage medium that can selectively vary embedding specification of digital watermark data
EP1359754B1|2007-03-21|Digital video copy protection
US6111990A|2000-08-29|Digital-watermark superposing apparatus and digital-watermarker detecting apparatus
JP2001061052A|2001-03-06|Method for inserting electronic watermark data, its device and electronic watermark data detector
JP4035257B2|2008-01-16|Image processing apparatus, image processing method, and computer-readable storage medium
CA2226719C|2001-09-11|Image data illegal use prevention system
JP2001111808A|2001-04-20|Electronic watermark data inserting system and device
JP2009534968A|2009-09-24|Digital watermarking method
JP4370752B2|2009-11-25|Digital watermark detection device
JP3269442B2|2002-03-25|A system to prevent unauthorized use of image data
Ghosh et al.2003|Watermarking compressed video stream over Internet
JP2004222322A|2004-08-05|Method of inserting electronic watermark data, and system
Piva et al.2004|Video Watermarking: Approaches, Applications, and Perspectives
Leiss2005|Time-Variant Watermarks for Digital Videos: An MPEG-Based Approach
同族专利:
公开号 | 公开日
KR19980071868A|1998-10-26|
US6553070B2|2003-04-22|
JPH10243398A|1998-09-11|
SG78286A1|2001-02-20|
EP0860793A2|1998-08-26|
EP0860793A3|1999-01-27|
JP3137022B2|2001-02-19|
KR100309521B1|2001-12-17|
CA2229826C|2002-04-16|
CA2229826A1|1998-08-24|
引用文献:
公开号 | 申请日 | 公开日 | 申请人 | 专利标题
US20030138127A1|1995-07-27|2003-07-24|Miller Marc D.|Digital watermarking systems and methods|
US20030172275A1|2002-03-11|2003-09-11|Seung Wook Lee|Real-time blind watermarking method using quantization|
US20080056671A1|1998-08-27|2008-03-06|International Business Machines Corporation|System and method for embedding additional information in video data|
US20080137749A1|2001-09-10|2008-06-12|Jun Tian|Assessing Quality of Service Using Digital Watermark Information|
US20100045794A1|2006-12-14|2010-02-25|Tredess 2010, S.L.|Method for marking a digital image with a digital water mark|
US20100115616A1|2008-10-31|2010-05-06|Jogand-Coulomb Fabrice E|Storage Device and Method for Dynamic Content Tracing|
US20100332723A1|2009-06-26|2010-12-30|Lin Jason T|Memory Device and Method for Embedding Host-Identification Information into Content|
US8155378B2|2000-02-14|2012-04-10|Digimarc Corporation|Color image or video processing|
CN103310403A|2013-05-14|2013-09-18|深圳市威富多媒体有限公司|Handwriting characteristic and digital document visible watermark fusion method|
US20150003608A1|2013-07-01|2015-01-01|Samsung Electronics Co., Ltd.|Method and device for authorizing video contents during video call|
CN110661760A|2018-06-29|2020-01-07|视联动力信息技术股份有限公司|Data processing method and device|KR930003757A|1991-07-31|1993-02-24|오오가 노리오|Video signal transmission device and method|
DE4430864C2|1994-08-31|2003-04-30|Mayah Comm Gmbh|Method for unnoticed transmission and / or storage of additional information within a source-coded, data-reduced audio signal|
US5530759A|1995-02-01|1996-06-25|International Business Machines Corporation|Color correct digital watermarking of images|
EP0766468B1|1995-09-28|2006-05-03|Nec Corporation|Method and system for inserting a spread spectrum watermark into multimedia data|
US6031914A|1996-08-30|2000-02-29|Regents Of The University Of Minnesota|Method and apparatus for embedding data, including watermarks, in human perceptible images|
US5809139A|1996-09-13|1998-09-15|Vivo Software, Inc.|Watermarking method and apparatus for compressed digital video|
JP3109575B2|1996-09-30|2000-11-20|日本電気株式会社|Image data processing device|
CA2221282C|1996-11-28|2001-07-31|Nec Corporation|Card type recording medium, certifying method and apparatus for the recording medium, forming system for recording medium, enciphering system, decoder therefor, and recording medium|
US5960081A|1997-06-05|1999-09-28|Cray Research, Inc.|Embedding a digital signature in a video sequence|
US6037984A|1997-12-24|2000-03-14|Sarnoff Corporation|Method and apparatus for embedding a watermark into a digital image or image sequence|US6229924B1|1996-05-16|2001-05-08|Digimarc Corporation|Method and apparatus for watermarking video images|
WO1998031152A2|1997-01-13|1998-07-16|Koninklijke Philips Electronics N.V.|Embedding supplemental data in a digital video signal|
FR2783658B1|1998-09-23|2000-10-13|Thomson Multimedia Sa|PROTECTION AGAINST COPYING OF DIGITAL DATA STORED ON AN INFORMATION MEDIUM|
EP1001604B1|1998-11-10|2004-04-28|Canon Kabushiki Kaisha|Embedding a watermark into a compressed image signal|
JP2000152148A|1998-11-13|2000-05-30|Hitachi Ltd|Electronic camera|
JP3407872B2|1999-09-29|2003-05-19|日本電気株式会社|Method and apparatus for detecting additional information|
JP2001346170A|2000-05-31|2001-12-14|Nec Corp|Data insertion strength adjustment method and data insertion circuit|
KR20010008048A|2000-11-04|2001-02-05|김주현|Watermarking method for digital contents|
US20030131350A1|2002-01-08|2003-07-10|Peiffer John C.|Method and apparatus for identifying a digital audio signal|
NZ539596A|2002-10-23|2008-11-28|Nielsen Media Res Inc|Digital data insertion apparatus and methods for use with compressed audio/video data|
US7460684B2|2003-06-13|2008-12-02|Nielsen Media Research, Inc.|Method and apparatus for embedding watermarks|
JP4208135B2|2003-11-07|2009-01-14|Kddi株式会社|Drift compensation method|
TWI404419B|2004-04-07|2013-08-01|Nielsen Media Res Inc|Data insertion methods , sysytems, machine readable media and apparatus for use with compressed audio/video data|
AU2005270105B2|2004-07-02|2011-03-31|Nielsen Media Research, Inc.|Methods and apparatus for mixing compressed digital bit streams|
US7904723B2|2005-01-12|2011-03-08|Interdigital Technology Corporation|Method and apparatus for enhancing security of wireless communications|
EP2958106B1|2006-10-11|2018-07-18|The Nielsen Company , LLC|Methods and apparatus for embedding codes in compressed audio data streams|
KR101953855B1|2014-04-01|2019-03-04|후아웨이 테크놀러지 컴퍼니 리미티드|Methods and apparatus for data hiding in multi-layer structured coding units|
CN106454510B|2016-10-31|2019-07-16|广东工业大学|A kind of original video watermark handling method and device|
法律状态:
1998-02-23| AS| Assignment|Owner name: NEC CORPORATION, JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:HASHIMOTO, MASAHIRO;REEL/FRAME:009000/0317 Effective date: 19980130 |
2003-04-03| STCF| Information on status: patent grant|Free format text: PATENTED CASE |
2006-09-29| FPAY| Fee payment|Year of fee payment: 4 |
2010-09-22| FPAY| Fee payment|Year of fee payment: 8 |
2011-11-01| AS| Assignment|Owner name: NEC PERSONAL COMPUTERS, LTD., JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:NEC CORPORATION;REEL/FRAME:027154/0170 Effective date: 20110901 |
2014-09-25| FPAY| Fee payment|Year of fee payment: 12 |
优先权:
申请号 | 申请日 | 专利标题
JP3907997A|JP3137022B2|1997-02-24|1997-02-24|Video encoding device|
JP9-039079||1997-02-24||
[返回顶部]